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In  this  timely  and  topical  essay,  Kent  Center  Research  Scholar  Jack  Davis  artfully 
employs  a  “question  and  answer”  format  to  examine  legitimate  policymaker  prerogatives 
and  appropriate  professional  standards  for  analysts  at  the  intersection  of  intelligence  and 
policymaking.  Tensions  between  these  two  communities  are  neither  exceptional  nor 
new,  but  are  most  intense  when  the  policy  stakes  are  highest-- such  as  in  decisions  about 
military  action,  as  recent  events  have  shown.  As  argued  here,  the  inherent  uncertainty 
associated  with  estimative  analysis  demands  analytic  rigor  and  clarity  on  the  part  of 
analysts  in  reaching  and  communicating  judgments,  while  accountability  for  action  taken 
entitles  policymakers  to  question  and  test  those  judgments  and  the  confidence  with  which 
they  are  held. 

Jack  Davis  has  been  associated  with  CIA  since  1956,  first  as  an  employee  and  since  1990 
as  an  independent  contractor.  Analytic  tradecraft  is  his  main  professional  interest,  and  the 
Kent  Center  welcomes  his  latest  contribution  to  the  ongoing  professional  dialogue  on 
analyst-policymaker  relations,  an  issue  that  will  inevitably  be  the  subject  of  lively 
engagement  among  professionals  as  new  facets  are  revealed  in  the  light  of  experience. 
The  views  expressed  here  are  the  author’s,  but,  as  always,  our  goal  in  presenting  them  is 
to  improve  the  doctrine  and  practice  of  intelligence  analysis. 
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Sherman  Kent  first  grappled  with  it  a  half-century  ago.1  Defining  the  role  of 
intelligence  analysts  in  the  policymaking  process  remains  very  much  a  work  in 
progress,  and  isoneon  which  the  Sherman  Kent  Center  for  Intelligence 
Analysis  welcomes  debate.2  This  essay  attempts  to  put  into  perspective  the 
cu  rrent  i  ntensi  ve  pu  bl  i  c  exami  nati  on  of  anal  yst-pol  i  cy maker  rel  ati  ons  tri  ggered 
by  judgments  on  Iraq'sWMD  capabilities  and  relations  with  al- Qa'ida 
terrorists  in  the  run  up  to  the  March  2003  U  Sled  military  invasion. 

The  essay  does  not  seek  to  render  a  substantive  appraisal  of  who  esti  mated  what 
and  why,  or  a  scorecard  of  whosejudgments  turned  out  to  be  right  or  wrong  in 
the  large  volume  of  intel  I  igence  analysis  and  policy  analysis  on  Iraq  produced 
before  the  war.  The  focus,  rather,  is  on  advancing  generally  applicable 
judgments  about  the  professional  prerogatives  of  analysts  and  pol  icymakers 
where  their  views  and  interests  seem  to  clash. 

Nine  questions  and  answers  about  policymaker  prerogatives  are  posed  hereto 
i  1 1  u  mi  nate  what  acti  ons  represent  I  egiti  mate  exerci se  of  thei  r  professi onal 
responsi  bi  I  i  ti  es.  The  text  al  so  add  resses  the  responsi  bi  I  i  ti  es  of  anal  ysts  as 
members  of  a  policy  service  organization  and  the  professi  onal  standards  they 
must  protect  in  order  to  ensure  their  distinctive  contribution  to  national  security. 

Firstacaution  and  then  a  reminder  for  readers  who  would  join  in  the  debate  to 
clarify  these  complex  and  sensitive  issues: 

•  The  essay  ad  dresses  the  prerogatives  of  CIA  analysts  as  intelligence 
professi  onal  sand  not  their  more  extensive  values  and  interests  as  citizens. 

•  Tensions  between  the  intel  I  igence  and  policymaking  communities  are  not 
an  exceptional  event  but  rather  a  recurring  pattern  reflecting  institutional 
differences  that  can  be  traced  back  throughout  the  Dl's  50-year  history. 

Analysts  and  Policymakers:  In  Search  of  Useful  Answers  for  Difficult  Questions 

1.  A  re  policymakers  entitled  professionally  to  reach  and  promote  estimative 
judgments  that  diverge  from  intelligence  assessments  on  a  national  security 
issue? 

As  a  student  of  the  complicated  relationship  between  the  two  distinct  but 
interrelated  national  security  communities,  I  would  argueyes. 


1  See,  for  example,  Kent  Center  Occasional  Papers,  V.2,  No. 3,  “Sherman  Kent’s  Final  Thoughts  on 
Analyst-Policymaker  Relations,”  June  2003. 

2  See  for  example,  Kent  Center  Occasional  Papers,  V.2,  No. 2,  “Tensions  in  Analyst-Policymaker  Relations: 
Opinions,  Facts,  and  Evidence,”  January  2003. 
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Administration  officials  engage  regularly  in  "policy  analysis,”  an  intellectual 
process  to  help  determine  what  policies  to  adopt  to  promote  the  serving 
President's  concept  of  national  security,  and  what  actions  to  take  to  execute 
agreed  policies.  Those  closest  to  the  President  also  engage  in  political  advocacy, 
domestically  and  abroad,  in  support  of  an  Administration's  national  security 
strategy  and  tactics. 

I  ntel  I  i  gence  anal  ysi  s,  especi  al  I y  i  nherentl y  f al  I  i  bl  e  i  nter pretati  ve  and  pred  i  cti  ve 
analysis,  isan  input  to— not  a  substitute  for—  policy  analysis.  Policy  analysts 
takeaccountof  other  providers  of  information  and  judgment,  and  also  bring 
their  own,  often  considerable,  experience,  insights,  and  biases  to  the  difficult  task 
for  which  they  must  take  ultimate  responsibility. 

Further,  policymakers  factor  into  their  judgments  regarding  the  meaning  of 
avail  able  information  on  national  security  issues  an  action-oriented  sense  of  risk 
and  opportunity.  What  analysts  may  see  as  an  unlikely,  even  remote, 
prospective  development,  policy  officials  may  see  as  a  risk  large  enough  to 
require  protective  measures,  or  as  an  opportunity  large  enough  to  leverage  to 
success  through  employment  of  US  carrots  and  sticks. 

Besides,  veteran  policy  officials  are  well  schooled  in  the  shortcomings  of 
intelligencejudgmentsarising  from  limited  and  ambiguous  information,  which 
most  analysts  also  readily  acknowledge.  In  addition,  policy  officials  tend  to  see 
intelligencejudgmentsasvulnerableto  substantive  bias,  and  at  times,  political 
bias— frailties  many  if  not  most  analysts  areloatheto  recognize. 

•  It  may  seem  to  analysts  that  pol  icymakers  are  more  prone  to  see  such 
deficiencies  when  intelligence  judgments  run  counter  to  policy 
preferences.  Perhaps  so;  but  then  more  the  reason  for  analysts  to  be  self- 
critical  and  open-minded  i  n  the  execution  of  tradecraft  on  potentially 
controversial  issues. 

Finally,  though  the  political  ball  cantakeodd  bounces  in  the  short  run,  policy 
of f i  ci  al  s  recog  n  i  ze  th  at  th ei  r  P  r esi  d  ent  u  I  ti  matel  y  w  i  1 1 1  i  kel  y  h o I  d  th  em 
responsible  for  errant  judgments  in  a  policy  assessment,  as  well  as  the  analysts 
on  whose  estimative  cal  I  they  may  have  relied  to  their  detriment. 


2.  Are  policy  officials  professionally  entitled  to  ask  intelligence  analysts  to  take 
another  look  at  their  estimative  judgments  (to  re-scrub  evidence  and 
argumentation)? 
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Again,  I  would  argueyes. 

The  reasoning  herelargely  follow  s  that  given  above  for  Question  1. 

Policymakers  are  commissioned  to  devise,  promote,  and  enact  the  President's 
national  security  agenda.  They  know  when  a  policy  consensus  is  taking  shape 
and  the  time  for  action  is  approaching  on  issues,  despite  intelligence  assessments 
that  sound  a  caution.  Yet,  especially  those  with  an  appreciation  of  the  distinctive 
roleof  intelligence  analysis  hesitate  to  ignore  intelligence  findings  and  estimative 
judgments  that  call  into  question  the  underpinnings  for  US  initiatives.  One 
response  i  n  these  ci  rcu  mstances  i  s  to  ask  anal  ysts  to  go  back  to  the  d  raw  i  ng 
board. 

A  policymaker's  cal  I  for  critical  review  of  intelligence  analysis  can  and  should  be 
a  healthy  stimulus  to  deliver  assessments  that  more  solidly  meet  the  twin 
professional  standards  of  substantive  insightful  ness  and  distinctive  policy  utility. 
Wei  I -articulated  criticism  of  analysis  is  much  preferableto  inadequate  guidance 
for  the  execution  of  intelligence  deliverables  and  scant  attention  to  the 
assessments  once  del  i  vered. 

Two  caveats. 

•  For  the  analysts,  the  cal  led-for  process  of  tough-minded  review  need  not 
result  in  abandonment  of  previously  well-reasoned  judgments.  The 
sought  after  result  can  be  analysis  with  essentially  the  same  conclusions 
that  are  more  transparent,  nuanced,  and  defensible  against  criticism. 

•  Policymaker  criticism  could  proveto  be  motivated  largely  by  political 
rather  than  tradecraft  concerns.  N  onetheless,  the  extra  effort  by  analysts 
would  help  Agency  leaders  if  they  were  cal  led  upon  to  defend  the 
integrity  of  the  analytic  process. 

3.  A  re  policymakers  professionally  entitled  to  urge  analysts  to  review  and  revise 
their  confidence  levels  in  analytic  judgments ? 

Here  too  I  would  argueyes. 

For  the  same,  usually  healthy,  reasons  one  analyst  or  intelligence  agency  chal¬ 
lenges  another's  conclusions  on  whether  a  shrouded  current  relationship  or  in¬ 
determinate  future  development  is  nearly  certain ,  probable,  or  unlikely,  policymak¬ 
ers  may  ask  analysts  to  rethink  their  degree  of  confidence  in  a  judgment. 
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Once  again,  the  argument  assumes  estimative  judgments  are  inherently  subject 
to  error;  policymaker  criticism  of  analysis  is  more  useful  to  sound  performance 
than  their  ignoring  of  analysis;  and,  just  likeanalysts,  policymakers  have  their 
own  distinctive  professional  roleto  play  in  the  national  security  process- 
moving  the  President's  agenda  forward— that  entitles  them  to  seek  the  best 
possi  bl  e  i  ntel  I  i  gence  i  nput. 

Needless  to  say,  intelligence  analysts  are  professionally  bound  to  stick  to 
judgments  on  probability  that  survive  their  critical  review.  Care  must  betaken 
not  to  al  low  the  pressure  of  a  process  of  repeated  requests  for  revision  to  move 
the  bottom  line  further  toward  one  supportiveof  policy  than  the  analytic 
tradecraft  would  justify. 

That  said,  analysts  are  also  professionally  obligated  not  to  dig  in  their  heels  in 
defense  of  an  initial  conclusion  instead  of  doing  an  open-minded  reevaluation. 
Analysts  and  the  Agency  can  lose  precious  credibility  through  dogmatism  as 
well  as  through  acquiescence  to  political  pressure. 


4.  A  re  policymakers  professionally  entitled  to  ask  analysts  to  provide  well-argued 
alternatives  to  their  studied  bottom  line  judgments  (eg.,  Devil's  Advocacy)? 

I  would  argueyes. 

Pol  icy  off  i  ci  al  s  are  at  I  east  as  w  ary  of  the  consequences  of  pol  i  cy  f  ai  I  u  re  as 
analysts  are  of  intelligence  failure.  They  are  professionally  entitled  to  task 
analysts  to  use  their  skills  and  resources  to  present  for  consideration  alternative 
or  multi  pie  views  of  a  complex  and  uncertain  issue.  Attimesacall  for,  say, 
Devil's  Advocacy  may  be  a  caution  against  the  peri  Is  of  Group  Think,  especially 
in  caseswhere  policymakers  agreewith  the  analysts' judgments.  Attimesthe 
policymakers'  motive  will  be  to  move  Agency  analysis  to  closer  alignment  with 
their  own  thinking. 

So  long  as  rigorous  analytic  tradecraft  norms  are  adhered  to  for  whatever  form  of 
alternative  analysis  is  solicited,  and  the  analysts'  preferred  bottom  line  is  firmly  attached 
to  the  deliverable,  intelligence  professionals  should  welcome  the  opportunity  for 
customized  service  to  their  policymaking  counterparts. 


5.  A  re  policymakers  professionally  entitled  to  ask  analysts  to  change  the  qu  estion 
they  address  (say,  from  "whether"  a  development  is  likely  to  "how"  it  might 
occur)? 
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My  answer  here  would  bean  emphaticyes. 

Once  an  Administration  adopts  an  initiative,  policymakers  tend  to  move 
forcefully  into  their  "action  officer"  mode  and  have  limited  interest  in  analysts' 
views,  based  on  the  latter's  reading  of  the  ground  truth,  on  whether  the  policy  is 
likely  to  succeed,  much  less  whether  the  policy  was  wise  to  undertake.  Policy 
officials  have  a  job  to  do— to  make  the  policy  work.  They  are  professionally 
entitled  to  ask  intelligence  analysts  to  provide  action  analysis;  that  is,  expert 
assessment  of  opportunities  for  moving  the  policy  forward  and  of  specific 
dangers  to  be  avoided. 

Whether  or  not  policy  officials  ask  for  a  change  in  analytic  focus,  once  a 
Presidential  initiative  is  underway,  analysts  are  professionally  obligated  to  make 
a  shift  in  effort  that  reduces  the  output  of  bottom-1  i  ne  esti  mati  ng  and  i  ncreases 
the  volume  of  customized  action  analysis.  This  shift  in  emphasis  tends  to  occur 
naturally  in  more  informal  lines  of  communications  (teleconferences,  working 
group  meetings).  But  analysts  are  often  slower  to  adaptto  the  requisite  value- 
added  in  written  products  and  formal  briefings. 

Analysts  must  take  care  in  assessing  tactical  policy  opportunities  to  retain  their 
role  as  members  of  an  intelligence,  or  policy  service,  organization.  Addressing 
potential  costs  and  risks  as  well  as  benefits  of  identified  opportunities  helps 
avoi d  a  si  i de  i nto  a  pol  i cy  advocacy  rol e. 

6.  Are  pol  i  cy  makers  professi  on  al  ly  en  ti  tl  ed  to  seek  an  alyti  cju  dgmen  ts  from  ou  tsi  de 
the  In  tel  I  igen  ce  Commun  i  ty? 

No  matter  how  strongly  intelligence  professionals  would  prefer  otherwise,  I 
would  argueyes. 

Policy  officials,  in  pursuitof  their  policymaking  and  political  goals,  havea  right 
to  rely  on  whatever  sources  of  information  and  insight  they  choose,  either  to 
supplement  or  to  substitute  for  the  support  they  get  from  intelligence 
professionals.  This  includes  use  of  business,  academicand  other  non¬ 
governmental  sources,  as  w el  I  as  thei  r  own  staffs,  whether  configured  as  a 
policymaking  or  intelligence  unit. 

Policymakers,  in  short,  are  entitled  to  reap  the  benefits  of  as  complete  and  varied 
a  set  of  substantive  inputs  as  they  can  command,  as  they  undertake  the  arduous 
task  of  managing  an  uncertain  and  often  perilous  national  security  issue. 

I  ntell  igence  professionals  must  earn  their  sought-after  seat  close  to  the  head  of 
the  table  by  ensuring  thesoundness  and  distinctive  utility  of  thei  r  assessments. 
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If  policymakers  usedifferent  sources  of  analytic  support  simply  because  they 
want  morecordial  answers  than  those  provided  by  intelligence  professionals, 
then  the  policy  officials  must  bear  the  burdens  of  self-deception,  policy  failure, 
and  political  censure  when  such  outcomes  proveto  be  the  case. 

AsSherman  Kent  once  said,  intelligence  professionals  wish  not  only  to  know 
everythi  ng  but  al so  to  be  bel  i eved  w hen  they  speak.  N  ot  always,  but  often 
enough,  tough-mi  nded  tradecraft  is  the  key  to  credi  bi  I  ity  with  tough-mi  nded 
policy  officials,  and  to  a  competitive  position  in  what  for  many  national  security 
issues  is  a  buyer's  market  for  insight  and  judgment. 

•  To  know  everything  and  to  be  believed,  however,  analysts  are  well 
served  to  be  well  informed  on  and  to  take  a  studied  measure  of  the 
information  and  viewsfrom  outsidethelntelligenceCommunity  on 
which  their  policy  cli ents  often  rel y . 


7.  A  re  policymakers  professionally  entitled  to  attribute  to  intelligence  analysts 
judgments  that  overstate  or  understate  analysts'  confidence  levels? 

I  would  argue  emphatically  for  an  answer  of  no. 

On  potentially  controversial  issues,  intelligence  analysts  should  increase  their 
attention  to  evaluating  evidence  for  authenticity  (protection  against  denial  and 
deception)  and  diagnosticity  (protection  against  acceptance  of  the  first 
apparently  supportable  line  of  analysis).  Equally  important,  they  should  take 
extra  care  to  avoid  confusion  in  conveying  probabilistic  judgments  (protection 
against  vague  phrases  such  as  "may  indicate”). 

Once  a  studied,  clear,  and— if  challenged— revisited  statement  of  likelihood  is 
established  by  Agency  analysts,  policy  official  scan  attributeitto  intelligence  in 
order  to  buttress  their  own  views,  or  reject  it  in  favor  of  their  own  alternative 
statement  of  likelihood.  But  they  should  not  have  the  authority  to  attribute  to 
i  ntel  I  i  gence  p  rof  essi  on  al  s  an  esti  mati  ve  j  u  d  g  men  t  the  I  atter  d  o  n  ot  hoi  d . 

The  analysts'  response  if  confidence  levels  are  attributed  to  them  inaccurately 
should  be  to  call  the  issueto  the  attention  oftheDCI  through  Dl  management 
channels.  TheDCI  should  then  decidewhethertheappropriateremedy  for 
protecting  Agency  integrity  is  a  pri  vate  demarche  to  the  policymakers  or  a  public 
correction  of  themisattribution. 
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8.  A  re  policymakers  professionally  entitled  to  force  analysts  to  alter  their  best 
estimative  judgments? 

An  equally  emphatic  no. 

A  s  al  ready  acknow  I  edged ,  pol  icy  off  i  ci  al  s  are  enti  tl  ed  professi  onal  I  y  to  reject 
intelligence  assessments  and  reach  and  promote  their  own  estimative  judgments 
(Question  1,  above),  and  are  also  entitled  to  urge  analysts  to  rethink  and  recast 
Agency  intelligence  judgments  (Question  3,  above). 

That  clarified,  under  no  circumstances  are  policy  officials  professionally  entitled 
to  force  intell  igence  analysts  to  change  esti  mative  judgments. 

Obviously,  there  are  risks  to  standing  firm  on  a  judgment  that  is  contrary  to 
policy  preferences.  Events  may  prove  the  analysts  to  be  wrong.  Congressmen 
may  complicate  the  funding  and  execution  of  Administration  strategy  and  tactics 
by  using  intell  igence  findings  and  esti  mative  judgments  to  block  or  modify 
policy  initi ati ves.  1) nauthorized  I eaks  to  the  med i a  of  i ntel I i gence  posi ti ons— 
rarely  from  Agency  sources—  may  create  an  untimely  public  debate  over  policy. 
These  circumstances  can  cause  a  run-up  in  immediate  costs  ranging  from 
embarrassment  of  the  Ad  mini  strati  on  to  the  thwarting  of  what  history  may  judge 
to  have  been  a  sound  policy  initiative. 

But  the  long  term  costs  to  the  integrity  and  morale  of  intelligence  professionals  of 
forcing  them  to  change  their  judgments  will  likely  cause  much  greater  harm  to 
the  national  interest  by  weakening  a  vital  arm  of  the  national  security 
establishment. 

What  are  analysts  to  do  when  pressure  from  policy  officials  to  change  their 
judgments  is  seen  to  go  beyond  tradecraft  criticism  and  represent  bald  political 
force?  Once  again,  the  DCI  should  be  informed  through  Dl  management 
channels,  and  he  is  charged  with  deciding  on  measures  to  protect  the  Agency's 
integrity. 


9.  A  re  policy  officials  professionally  entitled  to  use  the  media  to  criticize  intelligence 
analysts'  competence,  in  an  effort  to  protect  the  A  dministration  from 
congressional  and  public  criticism  of  a  policy  initiative? 

A  final  answer  of  no. 
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As  argued  above,  policy  officials  are  entitled,  indeed  encouraged,  to  criticize 
through  government  channels  either  a  specific  body  of  analysis  or  intelligence 
tradecraft  generally.  Furthermore,  as  policy  professionals,  they  are  entitled  to 
rai se  pu  bl  i  cl y  thei  r  cr i ti  ci sm  of  anal ysi  s  so  I ong  as  i t  i  s  couched  i  n  anal yti  c  terms 
and  is  not,  in  effect,  a  politically  motivated  ad  hominem  attack.  That  is,  as  policy 
professionals,  they  are  not  entitled  to  criticize  publicly  a  careful  body  of 
intelligence  work  and  the  credentials  of  the  analysts  who  produced  it  merely  to 
relieve  themselves  of  the  burden  of  credibl  e  defense  of  their  own  contrary 
judgments. 

In  principle,  nearly  all  parties  to  the  uniquely  American  system  for  making 
national  security  policy  proclaim  the  value  of  integrity  of  intelligence  analysis.  A 
practice  of  trying  to  leverage  a  Congressional  vote  or  public  debate  on  a  policy 
initiative  by  criticizing  the  credentials  of  analysts  who  produce  uncongenial 
analysis  undermines  the  principle. 

The  analysts'  recoursewhen  they  encounter  what  they  judge  to  be  unprincipled 
public  criticism  is  to  inform  the  DC  I .  As  indicated  earlier,  one  reason  for 
i  ntel  I  i gence  anal ysts  to  take  extra  care  w  i th  tradecraft  on  potenti  al  I y 
controversial  national  security  issues  is  to  providetheDCI  with  a  strong  casein 
any  private  or  public  defense  of  Agency  performance. 


A  Final  Word 

As  a  group,  these  are  tough  questions,  and  the  answers  provided  will  probably 
not  fully  satisfy  those  who  have  experienced  the  crossfire  between  analysts  and 
policymakers. 

The  analyst-policymaker  relationship  is  institutional  and  personal,  as  well  as 
professi  onal ,  and  the  dy  nami  cs  vary  both  across  i  ssues  and  over  ti  me.  M  utual 
understanding  of  professional  values  and  modes  of  behavior  will  be  tested  most 
when  the  policy  stakes  are  highest.  Analysts,  therefore,  face  a  recurring 
challenged  maintaining  both  their  professional  standards  and  effective  relations 
with  policy  clients  on  the  issues  that  matter  most  to  both  parties.  Knowing  when 
to  call  "foul"  will  always  bedifficult 
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Important  lessons  on  policy  relations  amidst  uncertain  ground  rules  can  be 
learned  in  a  fashion  while  analysts,  alone  and  as  teams,  are  under  the  gun.  Much 
of  value  can  also  be  learned,  with  much  less  risk  and  pain,  by  sharing 
experiences  and  debating  insights  informally  and  in  theclassroom— which  this 
essay  is  intended  to  encourage  readers  to  do. 


10 


